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ABSTRACT 

Traditional  methods  of  analysing  questions  and 
answers  as  they  occur  in  reference  libraries  are  discussed 
and  criticised*  Methods  of  examining  questions,  the 
que st io a- answer ing  process,  and  answers  to  questions  are 
evaluated.  A  pragmatic  scheme  is  suggested  which  classi¬ 
fies  answers  by  their  formats,  dividing  them  into  exact- 
rsproduetlon  type,  fill-in- t  he- L la nk  type,  short  descrip¬ 
tive  type,  information-about  type,  and  list-of -references 
type.  This  classification  is  applied  to  a  collection  of 
actual  inquiries.  Recommendations  for  further  testing  of 
tb®  suggested  c lass if ic at ion  are  given,  with  a  discussion 
of  its  value  in  present  and  future  libraries. 
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ABSTRACT 


Traditional  methods  of  analyzing  questions  and 
answers  as  they  occur  in  reference  libraries  are  discussed 
and  criticized.  Methods  of  examining  questions,  the 
question-answering  process,  and  answers  to  questions  are 
evaluated.  A  pragmatic  scheme  is  suggested  which  classi¬ 
fies  answers  by  their  formats,  dividing  them  into  exact- 
reproduction  type,  f ill-in-the-blank  type,  short  descrip¬ 
tive  type,  lnformat ion-about  type,  and  list-of-references 
type.  This  classification  is  applied  to  a  collection  of 
actual  inquiries.  Recommendations  for  further  testing  of 
the  suggested  classification  are  given,  with  a  discussion 
of  its  v$lu®  in  present  and  future  libraries. 
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AN  AM  LYSIS  OF  QUESTIONS  AND  ANSWERS  IN  LIBRARIES 

INTRODUCTION 

Librarians,  at  least  for  the  last  half-century,  have 
been  concerned  about  library  users*  needs  and  the  users' 
opinions  about  the  filling  of  these  needs.  As  members  of 
a  profession  which  considers  itself  service-oriented,  li¬ 
brarians  have  attempted  by  various  techniques  of  examina¬ 
tion  and  evaluation  to  assess  the  services  offered  by  li¬ 
braries,  and  then,  in  light  of  the  results,  to  Improve 
these  services.  The  acquisition  of  a  well-rounded  and  use¬ 
ful  book  collection  was  the  purpose  of  many  of  the  early 
studies;  later  ones  were  conducted  with  an  eye  to  improving 
training  of  personnel  and  arrangement  of  facilities,  estab¬ 
lishing  policies  such  as  telephone  reference  service,  and 
developing  better  means  of  record-keeping. 

In  no  area  of  librar ianship  has  there  been  greater 
difficulty  In  analyzing  services  rendered  than  in  the  field 
of  reference  work.  The  problem  is  inherent  in  the  non¬ 
routine  nature  of  the  work,  and  has  been  compounded  by  a 
general  lack  of  knowledge  about  the  quest ion-and-answer 
process  itself. 

Libraries  now  are  bearing  increasing  responsibilities 
for  making  information  available  to  a  growing  number  of 
serious  inquirers,  arsi  new  methods  of  doing  this  are  being 
developed  and  Implemented.  Reappraisals  of  reference 
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service  and  better  knowledge  of  the  types  of  answers  de¬ 
sired  by  seekers  of  information  sire  therefore  needed.  To 
this  end,  traditional  techniques  of  evaluation  of  reference 
work  should  be  analyzed  and  untried  oneB  considered. 
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PART  I 
USE  STUDIES 

Most  attempts  i-o  evaluate  library  reference  work  have 
taPen  the  form  of  use  studies,  performed  either  by  count¬ 
ing  and  classifying  questions,  or  by  Investigating  the 
ways  in  which  library  users,  generally  scientists,  seek 
information. 

Among  ohe  simplest  types  of  use  studies  are  reference 
or  citation  counts.  Footnotes  and  bibliographies  of  Jour¬ 
nal  articles  are  examined  in  order  to  discover  which  Jour¬ 
nals  are  most  frequently  referred  to.1  In  this  way  librar¬ 
ians  can  ensure  that  the  most-cited  Journals  are  in  their 
collections.  The  disadvantage  is,  of  course,  that  the  ci¬ 
tations  do  not  necessarily  reflect  what  the  articles' 
authors  knew  at  the  time  of  writing,  but  rather  what  was 
available  (and  indexed). 

Acquisitions  policies  have  also  been  reviewed  by 
studying  card  catalog  use.  Patrons  using  library  card 
catalogs  are  watched  or  interviewed  to  learn  wnich  materials 
they  are  seeking  and  how  successful  they  are  in  their 


"-Some  examples  are:  R.  C.  Coile,  "Periodical  Litera¬ 
ture  for  Electrical  Engineers,"  J ournal  of  Documentation. 

8  (1952),  pp*  209-226;  H.  H.  Fussier,  "Characteristics  of 
the  Research  Literature  Used  by  Chemists  and  Physicists  in 
the  United  States,"  Library  Quarterly.  19  (1949),  pp.  19- 
35,  119-143;  and  H.  H.  Henkle^  r,The  Periodical  Literature 
of  Biochemistry, "  Medical  Library  Association  Bulletin.  27 
(1933),  pp.  139-147. 


searches*  Some  of  these  studies  have  as  their  purpose  the 
improvement  of  descriptive  cataloging  or  the  rearrangement 
of  the  catalog  itself.  Examples  of  card  catalog  use  stud- 

p 

ies  are  the  investigations  of  Jackson  and  of  Brooks  and 
Kilgour.-^ 

The  first  analyses  of  actual  reference  questions  were 
done  in  public  libraries,  a  result  not  only  of  these  li¬ 
braries'  being  the  first  to  offer  reference  service  but 
also  of  the  social  changes  brought  by  the  Depression  era,^ 
The  results  of  most  of  the  studies  conducted  during  the 
1930's  and  1940 's  are  summarized  in  Bernard  Bere Ison's  The 
Library 1  a  Public.^  While  the  various  studies  differed  in 
approach  and  in  emphasis,  most  of  them  classified  users  by 
occupation  and  questions  by  subject.  Reference  questions 
asked  in  public  libraries  during  periods  ranging  in  length 
from  one  day  to  20  years  were  categorized,  usually  accord¬ 
ing  to  the  Dewey  Decimal  system.  It  was  generally  found 
that  the  majority  of  users  could  be  classed  as  professional 
workers  and  students,  and  that  their  queries  fell  mainly 

2 

Sidney  L.  Jackson,  Catalogue  Use  Study  (Chicago,  1958). 

•^B.  Brooks  and  F.  G.  Kllgour,  "Catalog  Subject  Searches 
in  the  Yale  Medical  Library,"  College  and  Research  Librar¬ 
ies.  25  (1964),  pp.  483-487. 

^Philip  H.  Ennis  and  F.  N.  Fryaen,  "Library  in  the 
Community,  Dae  Studies  Revisited,"  Library  Quarterly.  30 
(I960),  p.  253. 

^Bernard  Bere  Ison,  The  Library 1  s  Public  (New  York, 


1949). 


n 

into  the  300's,  600*s,  and  900* s  of  the  Dewey  Decimal 

/** 

c lassification.0 

The  results  of  these  investigat ions  seem  to  have  lit¬ 
tle  relevance  to  present-day  reference  work.  Glassifica¬ 
tion  of  questions  into  broad  subject  areas  was  useful  in 
formulating  acquisitions  ana  training  policies,  but,  with 
the  ever-increasing  number  of  subjects  of  inquiry,  it  is 
unrealistic  to  use  categories  set  up  nearly  a  century  ago. 
The  Dewey  Decimal  classification  is  inadequate  for  collec¬ 
tions  of  large  public  libraries,  let  alone  research  librar 
ies,  and  there  is  no  reason  to  suppose  that  it  is  any  more 
satisfactory  for  research  questions. 

An  exception  to  classification  by  subject  was  the  ays 
tem  devised  by  Alexander.^  He  grouped  questions  into  the 
following  seven  types: 

1,  Fact  type 

(a)  Meaning  type 

(b)  Numerical  or  statistical  type 

(c)  Historical  type 

(d)  Exact  wording  type 

(e)  Proper  name  type 

2.  How  to  do  type 


°Exaraples  of  these  studies  are  listed  in  the  bib¬ 
liography. 

n 

Garter  Alexander,  "The  Technique  of  Library  Search¬ 
ing,"  Special  Libraries.  27  (1936),  pp.  230-238. 
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3.  Trends  type 

4*  Supporting  evidence  type 

5.  "All  about”  type 

6.  Evaluation  of  reference  type 

7.  Duplication  of  previous  work  type. 

Alexander's  seven  types  were  later  expanded  to  13  by 

Dorothy  E.  Cole,  who  was  unable  to  fit  all  of  the  inquiries 
she  was  analyzing  into  Alexander's  categories.  Cole  found, 
that  fact  type  questions  accounted  for  55%  oi  her  total; 
general  information  type  (her  substitution  for  Alexander's 
"all  about”  type),  for  20$;  how  to  do  type  for  10$;  and 
supporting  evidence  type  for  8$*® 

A  different  approach  was  followed  by  Chalt,  whose  pur¬ 
pose  was  to  learn  which  sources  were  most  frequently  used 
to  find  answers  to  questions  asked  in  branches  of  the  Brook¬ 
lyn  Public  Library.^  Chait  felt  that  an  analysis  of 
sources  could  form  a  basis  for  acquisitions  policies,  aid 
in  training  reference  personnel,  and  help  in  arriving  at  a 
convenient  and  useful  shelf  arrangement. 

Florence  Van  Hoe sen  also  analyzed  sources  as  well  as 
questions  in  her  doctoral  dissertation,  an  attempt  to 

0 

Dorothy  E.  Cole,  "Some  Characteristics  of  Reference 
Work,"  College  and  Research  Libraries .  7  (1946),  pp.  45- 

51. 

^William  Chait,  "Books  and  Other  Sources  Used  in 
Adult  Reference  in  Branches  of  the  Brooklyn  Public  Library" 
(Unpublished,  1938). 
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outline  a  new  method  of  teaching  reference  work.-1*'  Beth 
the  Chait  and  Van  Hoesen  studies,  incidentally,  found  that 
questions  in  the  fields  of  social  science,  science,  and 
biography  predominated.  Van  Hoesen  also  classified  her 
questions  by  type.  Requests  for  specific  facts,  general 
information,  and  "how-to~do~lt"  information  were  the  most 
frequent. 

Since  the  publication  of  Bere Ison's  book  in  1949, 
there  has  been  little  organized  effort  on  the  part  of  pub¬ 
lic  libraries  to  assess  their  reference  services.  This  is 
probably  partly  because  of  the  definitive  nature  of  The 
Library 1 s  Pub lie  and  partly  because  of  the  increased  work¬ 
load  of  reference  librarians  in  the  1930's  and  I960' a. 

Many  reference  librarians  tally  the  questions  they  receive, 
often  breaking  th^m  down  by  the  amount  of  time  it  takes  to 
answer  them,  a  factor  that  depends  as  much  on  the  quality 
of  the  librarian  and  the  collection  as  on  the  question# 

The  totals  appear  in  statistical  reports  but  the  subtotals 
are  seldom  evaluated. 

The  general  conclusion  of  librarians  seems  to  be  that 
quantitatlve  measurements  of  reference  work  have  little 
value*  Louis  Shores  writes: 

"Classification  of  questions  by  type,  or  by  in¬ 
quirer,  or  by  sources  consulted,  or  by  purpose, 


F,  R.  \[&n  Hoesen,  "An  Analysis  of  Adult  Reference 
Work  in  Public  Libraries  as  an  ADproach  to  the  Content  of 
a  Reference  Course"  (Unpublished,  1948)* 
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all  present  formidable  obstacles  both  as  tc 
validity  and  reliability*” ■** 

A  recent  exception  has  been  the  -work  of  .Margaret 
Slater#  who  has  analyzed  questionnaires  administered  to 

users  of  industrial,  government,  university,  and  learned 

12 

society  libraries  in  Great  Britain*  She  classified  her 
data  by  user  employment  and  type  of  use  of  libraries* 

Among  her  findings  was  that  most  requests  for  information 
were  for  simple  factual  data  or  for  a  description  of  an 
object,  process,  or  method. 

The  examinations  of  public  libraries  were,  for  the 
most  part,  conducted  from  within.  The  recent  concern  with 
scientists  and  how  they  use  information  h&B  led  to  broader- 
based  analyses  of  "inf  or  mat  ionr- see  king  behavior."  These 
studies  include  the  library  as  only  one  of  maty  possible 
sources  of  knowledge  for  a  specialized  group  of  people.^ 
It  is  difficult  to  draw  any  conclusions  from  these  in¬ 
vestigations.  One  problem  is  pointed  out  in  the  POD  User 
Needs  Study,  which  found  that  the  studies  generally 

"suffered  from  the  weakness  of  being  based  on 
the  opinion  of  the  user.  The  problem  is  that 


^Louis  Shores.  "Measure  of  Reference,"  Southeastern 
Librarian.  11  (1961),  p.  301. 

12 

Margaret  Slater,  Technical  Libraries :  Users  a^.i 
Their  Demands.  §.  Classification  of  User  Groups  and  User 
Demands  in  Technical  Libraries  (London,  1964) . 

13 

■^Several  studies  of  this  type  are  listed  in  the  bib¬ 
liography.  The  classic  example  is  perhaps  D  B.  Hertz 
and  A.  H.  Rubenstsin,  Team  Research  (Boston,  1953)  • 
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uilO  lioSX*  I ucyT  not  llcaV B  »n  Cido v|u»tO  Da 5  to  jTOa' 
rendering  a  reliable  opinion  as  to  the  types  or 
characteristics  of  information  services  since 
he  majTjjjict  have  had  any  direct  experience  with 
the  m  • 

Another  difficulty  is  that  of  Inconstant  variables. 
Groups  of  users  of  various  numbers  and  subject  special¬ 
ties  and  in  different  settings  have  been  asked  a  wide 
variety  of  questions.  The  resulting  answers  may  be  help¬ 
ful  in  the  particular  organization  studied,  but  one  cannot 
easily  extrapolate  from  them  to  the  total  universe  of 
serious  inf ormat ion-seekers . 

The  findings  on  which  most  investigators  -  social 
scientists,  scientists,  and  librarians  -  agreed  are  that: 

1.  Pure  and  applied  scientists,  technicians, 
management  personnel,  and  other  non- technical 
personnel  have  different  aims  in  seeking 
Information. 

2.  Pure  scientists  are  likely  to  seek  informa¬ 
tion  within  their  own  field  of  endeavor;  applied 


Auerbach  Corporation,  POD  User  Meeds  Study 
(i  hlladelphia,  1965),  p.  2.1. 

15 

These  points  are  drawn  from  the  studies  of  Herner 
and  Menzel  in  the  United  States,  and  those  of  Cole;  Mote 
and  Angel;  Sabe 1,  Terry,  and  Moss;  Martyn;  and  Slater  in 
Great  Britain.  A  discussion  and  evaluation  of  the  results 
of  all  of  these  investlgat ions  may  be  found  in  C.S.  Hanson, 
Research  on  User's  Needs;  Where  Is  It  Getting  Us?“,  As  lib 
Proceedings.  16  (1964),  op.  64-74. 
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scientists  and  non- technical  personnel  need 
Information  from  peripheral  fields.1 

3.  Pure  scientists  are  leas  likely  than  applied 
scientists  to  ask  for  help  from  a  librarian* 

4.  Scientists  are  more  likely  to  use  libraries 
to  perform  exhaustive  searches  than  to  keep 
abreast  of  current  developments  in  their  fields. 

5.  Scientists  use  informal  communication  net¬ 
works  to  get  information,  often  more  than  they 
use  libraries. 

6.  Journal -articles  are  the  favored  printed 
sources  of  information* 

7*  Library  users  will  more  often  ask  for  speci¬ 
fic  material  by  its  author  or  title  than  by  its 

subject* 

8.  When  a  reference  question  is  asked,  the  query 
is  usually  either  for  a  single  fact  or  for  a 
description  of  a  process,  method  or  technique* 

Most  of  these  tentative  conclusions  could  have  been 
reached  by  a  little  Intelligent  observation  and  hard 


l6Re  levant  to  points  1  and  2  is  Derek  J.  De  Soila 
Price's  article,  "is  Technology  Historically  Independent 
of  Science?  A  Study  in  Statistical  Historiography," 
Technology  and  Culture,  6  (1965),  PP»  553-568.  One  of  his 
conclusions  is  that  the  "cumulations  of  the  literatures  of 
science  and  technology  serve  separate  ends," 


thinking  on  the  part  of  someone  working  in  a  research  li¬ 
brary.  Unfortunately,  this  was  not  formally  done  by  any¬ 
one,  and  use  studies  have  proliferated.  Mortimer  Taube, 
use  studies'  most  devastating  critic,  asks: 

"Why  do  use  studies  continue  to  accumulate  in 
the  face  of  a  general  recognition  that  they  have 
so  far  contributed  little  to  the  purpose  for 
which  they  are  primarily  intended?  The  answer 
to  this  question  is  to  be  found  in  the  fact  that 
use  studies  have  been  criticized  in  terms  of 
their  metnodology . . . .So  much  of  social  activity 
seems  amenable  to  poll.8,  surveys,  questionnaires, 
etc.,  that  it  seems  reasonable  to  apply  similar 
techniques  ta  the  problems  of  scientific  in¬ 
formation.  !l  Ll 

The  reaaon  for  use  studies'  lack  of  success,  says 
Taube,  is  that  professional  services,  unlike  consumer  serv¬ 
ices,  cannot  be  measured  in  terms  of  consumer  response,  but 
possess  "criteria  of  evaluation  which  are  independent  of 
consumer  response."  He  concludes  that  "use  studies  have 
no  value  as  direct  guides  to  the  design  of  information  sys¬ 
tems,  any  more  than  consumer  acceptance  or  rejection  is  a 
guide  to  tne  Salk  vaccine." ^9 

Most  critics,  such  as  Taube,  who  have  attacked  use 
studies  have  offered  no  positive  substitutes  for  them. 


17 

‘Mortimer  Taube,  An  Evaluation  of  "Use  Studies"  of 
Scientific  Information  (Washington,  1958),  pp.  7-8. 

18 Ibid.,  p.  8. 

19 Ibid.,  p.  ll. 
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One  who  holds  out  some  hope  is  R.  D.  Rogers  who,  although 
he  calls  statistics  "an  occupational  hazard,"  believes 
that  "precise,  derailed,  and  expert  analysis  of  small 
samples  of  circulation  and  reference  work  might  produce 
valid  conclusions  of  significance."20 


2oR.  D.  Rogers,  "Measurement  and  Evaluation,"  Library 
Trends.  3  (1954),  pp.  184-185. 
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PART  II 

SOME  ALTERNATIVE  METHODS 

Rogers  feels  that  the  proper  consumers  of  significant 
conclusions  about  reference  work  are  appropriating  bodies 
and  patrons.  The  hope  for  eventual  quest  ion- answer ing  via 
man- machine  Interaction,  with  the  concurrent  need  to  trans¬ 
late  questions  into  linguistic  forms  computers  can  handle, 
is  another  pragmatic  Justification  for  the  study  of  quest¬ 
ions  and  answers.  Furthermore,  the  quest ion-and- answer 
process  is  interesting  enough  to  provide  a  rationale  for 
such  a  study  for  its  own  sake. 

The  remainder  of  this  paper  is  a  report  of  an  examina¬ 
tion  of  a  set  of  actual  reference  queries  in  light  of 
several  theories  about  questions  and  answers.  The  subjects 
of  this  analysis  are  272  inquiries  received  at  the  reference 
desk  of  the  Lehigh  University  Library  during  a  two-year 
period,  from  November  1963  through  October  1965* 

The  Lehigh  University  library  serves  a  faculty  of  400 
and  a  student  body  of  4500,  as  well  as  many  visitors  from 
industry  and  other  academic  institutions.  While  the  empha¬ 
sis  of  the  curriculum  has  traditionally  been  on  science  ard 
engineering,  the  university  has  Colleges  of  Arts  and  Sci¬ 
ence  and  Business,  a  graduate  school,  and  a  large  graduate 
program  In  education,  so  that  the  library  is  used  for 
reference  and  research  in  many  fields. 
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The  inquiries  studied  were  of  two  types:  ( 1)  those 
considered  interesting  or  difficult  by  experienced  refer¬ 
ence  librarians,  and  (2)  those  recorded  by  inexpert  .iced 
librarians,  who  were  instructed  to  note  all  questions  they 
were  asked.  While  the  272  questions  are  only  a  fraction 
of  the  total  asked  during  the  two  years,  it  was  felt  that 
they  were  sufficiently  representative  to  permit  fruitful 
study.  Since  some  of  the  questions  were  recorded  because 
they  were  unusual,  while  others  are  run-of-the-mill,  the 
collection  should  be  varied  enough  to  rnclude  most  types  of 
inquiries.  Directional  questions  and  requests  for  specific 
library  holdings  or  for  instruction  in  the  use  of  library 
materials  are  not  considered  here. 

It  should  be  noted  that  the  questions  studied  are  in 
their  final  form,  as  agreed  upon  by  the  inquirer  and  the 
librarian.  The  "negotiations"  leading  up  to  this  agreement 
are  themselveB  deserving  of  considerable  study.  Seldom  is 
a  question  as  it  is  first  asked  the  real  question  'o  which 
the  inquirer  want,  an  answer.  Every  reference  librarian 
is  familiar  with  such  queries  as  "Have  you  ary thing  on...?" 
or  "Will  you  give  me  all  of  the  Information  about...?" 
which  turn  out,  after  extensive  Interviewing,  to  be  expres¬ 
sions  of  needs  for  very  specific  pieces  of  Information. 

The  patron  who  asks  for  "boo^s  on  science"  when  he  wants  to 
know  how  to  dissect  a  frog  3  typical  of  library  users  who 
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believe  that  the  only  way  to  get  anything  from  a  library 
re  in  large,  general  packages.  Probably  among  the  reasons 
for  this  behavior  are  libraries'  lack  of  effective ‘ adver¬ 
tising  of  their  services,  and  previous  poor  service  the 
questioner  has  received. 

In  addition  to  narrowing  the  field  of  inquiry  as  far 
as  the  questioner  will  allow,  the  librarian  must  ascertain 
such  facts  as  the  educational  level  and  interest  of  the  in¬ 
quirer;  the  purpose  of  his  question,  if  this  will  be  help¬ 
ful  in  answering  it;  and  the  format  in  which  he  expects  or 
prefers  the  answer  to  be  presented. 

After  the  final  form  of  the  question  is  decided  upon, 
stll]  further  refinement  may  be  required.  For  example,  a 
patron  might  request  material  on  the  diplomatic  history  of 
the  United  States.  This  inquiry  is  "negotiated"  until  the 
librarian  learns  that  the  question  is  "Has  there  ever  been 
an  ambasseiuor  or  envoy  from  the  U.  S.  to  the  Vatican?"  Al¬ 
though  this  seems  to  be  a  perfectly  sensible  query,  the 
simple  yes-no  alternative  presented  has  a  further  implica¬ 
tion:  if  yes,  "Who  was  it?"  It  is  necessary  therefore  to 
follow  the  line  of  thought  suggested  by  each  question  to  it 
logical  conclusion. 

Analysis  of  the  Question 

The  most  obvious,  and  most  often  attempted,  method  of 
examining  the  question-answer  process  is  the  study  of  the 
question  itself.  A  question  lias  been  defined  as  a  revela- 
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tion  of  an  Inadequacy  in  the  inquirer  which  must  be  met  by 
a  readiness  to  help  in  the  inquiree.21  This  definition 
will  hardly  help  a  reference  librarian,  who  is  presumably 
already  motivated  to  answer  questions. 

The  traditional  approach  to  studying  questions  has 
been  to  classify  them  and,  as  previously  mentioned,  the 
classification  has  usually  been  by  subject.  The  rationale 
for  this  is  that  a  knowledge  of  subjects  commonly  asked  for 
is  helpful  in  building  collections  and  in  training  staff* 

A  more  theoretical  justification  is  Hlz’s  claim  that 
"knowledge  can  be  classified  according  to  what  questions  it 
answers."  This  may  not  have  been  what  Dewey  and  other 
classlf icatlonists  had  in  mind  when  they  devised  their 
schemes,  but  if  all  the  questions  that  have  been  and  could 
be  asked  in  libraries  were  classified  by  their  subjects,  the 
resulting  array  would  indeed  De  a  classification  of 
knowledge. 

In  real  life,  however,  there  is  always  the  unexpected, 
for  the  human  mind,  especially  in  the  aggregate,  ranges 
widely  in  itB  interests*  The  queries  recorded  at  the  Lehigh 
University  Library,  for  example,  included  such  diverse 

2*D.  M.  MacKav,  "The  Informational  Analysis  of  Quest¬ 
ions  and  Commands,"  in  Colin  Cherry,  ed.  Information 
Theory  (London,  1961),  p.  472. 

22Henry  Hiz, "Questions  and  Answers,"  Journal  of 
Philosophy.  59  (1962),  p.  253. 


items  as  requests  for  a  criticism  of  Walden  and  for  a  list 

of  the  standard  available  sizes  of  cold  rolled  steel  rods* 

Even  in  a  more  specialized  library,  the  rar^e  of  subjects 

cannot  be  predicted.  Herner  found  in  a  study  of  questions 

received  at  atomic  energy  research  organizations  that  18 °/o 

of  the  Inquiries  concerned  non- technical  subjects,  and 
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this  finding  has  been  borne  out  by  others. 

Another  a>.proach  is  to  classify  a  question  by  the  num¬ 
ber  of  concepts  it  contains,  and  their  re lationsnips  to  one 
another.  This,  however,  nay  be  unnecessary  for  practical 
purposes  for,  as  Horner,  one  of  the  foremost  students  of 
informat ion- seeking  behavior  and  of  retrieval  systems,  con- 
c ludes, 

'Questions  produced  by  the  groups  investigated 
/workers  in  a  pharmaceutical  laboratory/  were 
considerably  less  complicated  than  the  quest¬ 
ions  that  a  majority  of  retrieval  systems  are 
designed  to  handle.  They  generally  covered 
fewer  concepts,  and  required  far  simpler  logi¬ 
cal  manipulations  than  would  seem  likely  from 
most  discussions  of  storage  and  retrieval  sys¬ 
tems  in  the  documentation  literature."  ^ 

Although  tuis  may  be  a  result  of  the  inquirers'  previous 

experience  with  Information  retrieval  systems,  it  may,  on 

the  other  hand,  reflect  the  way  in  which  questions  are 


^Saul  and  Mary  Herner,  "Determining  Requirements  for 
Atomic  Energy  Information  from  Reference  Questions,"  in 
ICSI  Proceedings.  Vol.  1  (Washington,  1959),  p.  183* 

r~  j. 

^Hanson,  op.  clt. ,  p.  67. 

2^Saul  Herner,  The  Re latlonahlp  of  Inf ormatlon-Uae 
Studies  and  the  Design  of  Information  St or a ge  and  Retrieval 
Systems  Washington,  1958),  p.  15* 


asked.  Whichever  la  the  case,  the  method  Is  undesirable 
because  of  the  difficulty  of  determining  for  a  given  quest¬ 
ion  what  the  concepts  are,  and  their  relationship  to  one 
another.  While  It  is  probably  possible  to  analyze  such  a 
question  as  "How  many  paroled  prisoners  imprisoned  for 
murder  have  .committed  murder  during  parole?"  D  In  terms  of 
Its  concepts,  it  is  a  somewhat  time-consuming  task  to  per¬ 
form  this  operation  on  many  questions.. 

Cole's  revision  of  Alexander's  classification  of  types 
of  questions  la  perhaps  more  useful.  One  of  its  advantages 
is  that  it  can  be  adapted  to  specific  situations,  as  was 
done  by  Petrella  in  a  study  of  inquiries  in  a  business  11- 
brary,  '  He  changed  several  of  the  categories  tinder  "fact 
type"  so  that  they  fit  the  questions  most  often  asked.  Dif¬ 
ficulties  arise,  however,  in  assigning  questions  to  their 
proper  categories.  For  example,  the  "supporting  evidence 
type"  may  overlap  any  of  the  "fact  types",  because  the  in¬ 
quirer  may  be  using  the  facts  as  supporting  evidence.  The 
"how  to  do  type"  may  turn  out  to  be  of  the  "all  about  type", 
while  the  "duplication  of  previous  work  type"  could  include 
any  of  the  other  categories,  A  requirement  of  any  question 


All  questions  discussed  in  Parts  II  and  III  are 
actual  Inquiries  received  at  Lehigh,  with  the  exception  of 
the  George  Washington  example. 
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'James  A,  Petrella,  "A  Survey  of  Telephone  Reference 
Questions  at  the  Business  Information  Bureau,  Cleveland 
Public  Library,  Cleveland,  Ohio."  (Unpublished,  1951), 
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classification  is  that  it  may  be  applied  without  agonizing 
decision-making. 

Another  description  of  questions  has  been  done  by 
Beinap,  who  discusses  them  in  terms  of  the  alternatives 
they  present.  He  classifies  questions  as  "whether  quest¬ 
ions"  (having  a  finite  set  of  alternatives),  "which  quest¬ 
ions"  (having  a  condition  to  be  met  as  well  as  a  set  of 

names  or  terms  acceptable  as  answers) ,  and  "why  and  how" 

28 

questions"  (ambiguous  alternatives). 

The  "whether"  type  could  include  all  queries  of  the 
"do  you  have"  variety,  which,  although  not  discussed  as  such 
in  this  report,  form  a  large  proportion  of  any  library's  re¬ 
quests.  Other  "yes  or  no"  questions  when  analyzed,  however, 
usually  resolve  themselves  into  "which"  questions.  "Vias 
Beethoven  born  on  December  16?"  is  really  asking  "When  (on 
which  date)  was  Beethoven  born?"  The  "which"  category  es¬ 
sentially  includes  "whether",  "who",  "when",  "what",  and 
"where,"  leaving  out  only  "why"  and  "how".  The  "why"  and 
"how"  class  is  composed  of  demands  for  descriptions  and 
how-to-do-it  material,  and  all  generalized  requests  for  in¬ 
formation  about  a  subject.  Thus  boiled  down  to  only  two 
categories,  such  a  classification  is  of  little  use. 

28 

°K.  D.  Beinap,  Jr.,  An  Ana lv  s 1 s  of  Questions :  Pre¬ 
liminary  Report  (Santa  Monica,  California,  1963). 


Answering  the  Question 


Some  hint  of  the  complexity  of  a  question  may  be 
gained  from  a  study  of  the  steps  required  to  find  the  ana- 
war.  Such  an  Investigation  is  included  inGoldhor'a  exam¬ 
ination  of  reference  service  at  the  Evansville,  Indiana, 
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Public  Library.  A  fact  question  which  can  be  answered 
from  the  World  Almanac  might  be  considered  simpler  than  the 
inquiry  which  Involves  searching  a  periodical  index  and  then 
proceeding  to  the  periodical  itself.  The  latter  process, 
however,  is  quite  straightforward,  while  answering  a  simple 
fact  question  in  one  operation  may  require  considerable 
skill.  Furthermore,  an  investigation  of  search  strategies 
is  not  really  an  investigation  of  questions  and  answers. 

Several  studies  have  been  conducted  to  learn  the 
sources  in  which  answers  to  reference  questions  are  found, 
and  one  such  investigation  was  carried  out  briefly  at  Le¬ 
high.  The  method  was  found  to  have  one  advantage,  that  of 
ease  of  use.  An  indication  of  specific  sources  requires  no 
decisions  about  categories,  and  is  easy  to  perform  retro¬ 
spectively.  However,  such  a  list  as: 

2Q 

^Herbert  G-oldhor,  “Reference  Service  Analysis," 
Illinois  Libraries.  42  (I960),  pp.  319-322. 

■^°The  analyses  of  P.  F.  Cole  and  Van  Hoesen  show  the 
types  of  sources.  Lists  of  specific  sources,  arranged  by 
frequency  of  use,  are  given  by  Chait,  Chase,  D.  E.  Cole, 
Ludewlg,  am  Petrella. 
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World  Almanac 
Metals  Handbook 

Webs  '  ‘’s  Unabridged  Dictionary 
etc* 

grows  "cold",  and  nothing  of  the  nature  of  the  question  or 
its  answer  is  remembered*  Only  the  list  of  most  commonly 
used  materials  remains,  and  this  list  Is  probably  largely  a 
function  of  the  reach  of  the  librarian*  As  in  the  case  of 
the  amount  of  time  taken  to  find  the  answer,  the  source 
used  depends  on  the  skill  of  the  librarian  and  the  scope  of 
the  collection  as  much  as  on  the  question  or  the  answer. 

The  Inquirer*  s  Need 

Some  theoreticians  believe  that  the  best  way  of  cate¬ 
gorizing  use  of  library  materials  is  by  the  need  of  the  in¬ 
quirer,  or  his  purpose  in  asking  a  question.  Voigt  groups 
these  purposes  into  three  approaches  -  the  current,  the 
everyday,  and  the  exhaustive.^  He  believes  that  the  ap¬ 
proach  involved  is  reflected,  not  only  in  the  Inquirer's 
question,  but  also  in  the  materials  which  will  best  answer 
that  question. 

"Printed  information  used  in  the  current  approach 
normally  appears  in  only  one  location.  Informa¬ 
tion  wanted  in  the  everyday  approach  usually  can 
be  found  in  a  number  of  sources.  Where  data  is 
concerned,  the  source  easiest  to  find  will 
generally  be  used,  while  for  explanations  or 
methods,  other  considerations  -  the  clearest  ex¬ 
planations  or  the  best  method  -  also  enter  in... 


■^Melvin  J.  Voigt,  "The  Researcher  and  His  Sources  of 
Scientific  Information,"  Llbrl.  9  (1959),  PP.  177-195. 
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The  material  ultimately  used,  in  the  exhaustive 


approach  4a  most  often  the  original  research 
article. 


Menzel  has  reclassified  the  approaches  discussed  by 
Voigt  into  five:  current  awareness,  reference,  exhaustive 
search,  brushing  up,  and  stimulation  to  alter  the  boundaries 
of  one's  area  of  attention.^  He  says  that  "the  definition 
of  information. . .must  be  in  terms  of  characteristics  of  the 


messages  transmitted  or  in  terms  of  the  relation  of  these 
messages  to  the  receiving  scientist's  informat ion- seeking 
behavior.'*^ 


Since  in  real  life  it  is  often  not  feasible,  or  even 
polite,  to  ask  the  inquirer  why  he  needs  the  answer  to  his 
question,  unless  a  knowledge  of  how  he  will  use  the  informa¬ 
tion  will  be  of  definite  help  in  answering  the  question, 
practical  Investigations  must  be  in  terms  of  message  charac¬ 
teristics.  ▲  reversal  of  Voigt's  theory  about  approach  de¬ 
termining  source  may  be  in  order.  Perhaps  a  knowledge  of 
what  answered  the  inquirer's  question  will  reveal  something 
of  his  approach. 


32Voigt,  op.  .cits,  pp.  185-186. 

^Herbert  Mensel,  "The  Information  Needs  of  Current 
Scientific  Research,”  Library  Quarter Iv .  54  (1964),  pp,  4- 
19. 
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Analysis  of  the  Answer 

The  most  promising  method  of  discussing  the  question- 
answer  process,  therefore,  may  he  in  terms  of  the  answer. 
An  examination  of  the  answer  should  be  Just  as  useful,  if 
not  more  so,  than  an  examination  of  the  question.  Knowing 
the  question  may  Involve  the  problem  of  the  inquirer’s  not 
stating  his  need  precisely,  or  even  of  his  not  knowing  his 
need  at  «he  time  he  asked  his  question.  On  the  other  hand, 
if  the  answer  fulfills  the  conditions  finally  set  by  the 
inquirer,  it  is  in  some  way  a  statement  of  his  need.  It 
must  be  stressed  that  the  inquirer  must  be  satisfied,  at 
least  consciously,  by  the  answer  he  receives,  in  order  for 
a  study  of  answers  to  have  any  meaning. 

According  to  Hamblin,  "knowing  what  counts  as  an  ans¬ 
wer  is  equivalent  to  knowing  the  question, This  is  not 
strictly  true,  for  "George  Washington  was  the  first  presi¬ 
dent  of  the  United  States,"  may  answer  more  than  one  quest¬ 
ion.  The  question  may  have  been,  "7/ho  was  George  Washing¬ 
ton?";  "Which  president  of  the  United  States  was  George 
Washington?";  "What  office  was  George  Washington  the  first 
to  hold  in  the  United  States  government?";  or  "Of  what 
country  was  George  Washington  the  first  president?"  How¬ 
ever,  "knowing  what  counts  as  an  answer"  is  equivalent  to 

3*0.  L,  Hamblin,  "Questions,"  Australasian  Journal  of 
Philosophy,  36  (1958),  p.  162. 
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knowing  what  satisfies  the  questioner,  and  if  he  receives 
the  answer  he  needed,  his  question  is  no  longer  important* 

It  is  essential  that  all  of  the  alternatives  presented 
by  the  question  be  matched  by  the  ansver.  If  the  query  is 
"Was  George  Washington  the  first  president  of  the  United 
States?"  then  the  answer  "yes"  is  sufficient,  for  the  al¬ 
ternatives  are  simply  "yes"  or  "no"*  If  the  query  is  "Who 

• 

was  the  first  president  of  the  United  States?"  the  answer 
"George  Washington"  satisfies  the  condition  "first  president 
of  the  United  States,"  and  is  the  only  member  of  the  set  of 
names  acceptable  as  answers.  In  the  case  of  "Who  were  some 
presidents  of  the  United  States?",  the  condition  changes  to 
"presidents  of  the  United  States"  and  the  set  of  acceptable 
names  increases  to  35* 

The  size  of  the  set  of  acceptable  terms  in  the  answer 
is  referred  to  by  MacKay  as  the  "  logon-content*'  or  "logical 
dimensionality"  of  the  question.-^  The  logon-content  of 
"Who  was  the  first  president  of  the  United  States?"  is  one; 
that  of  "Who  were  some  presidents  of  the  United  States?"  is 
the  total  of  all  combinations  of  any  two  or  more  of  the  35 
names.  Answers  of  a  logon-content  of  one  are  usually  speci¬ 
fic  facts  or  figures.  Answers  of  larger  log on- contents  may 
be  lists,  as  In  ohe  case  of  the  presidents,  or  descriptive 

•^MacKay,  op.  clt. .  p.  474. 
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material  which  may  be  worded  in  a  number  of  different 
way  3  • 

The  obvious  procedure  in  studying  the  quest  ion-answer 
process  from  the  standpoint  of  the  answer  would  be  to  state 
the  answer  as  given*  This  quickly  becomes  unsatisfactory. 
Although  the  statement,  "Hitler  became  Chancellor  of  Ger¬ 
many  in  1933" »  answers  the  question,  "When  did  hitler  be¬ 
come  Chancellor  of  Germany?",  recording  the  answer  to  a 
request  for  proofreader's  marks  is  hardly  practical. 

David  Kronick,  in  a.:  article  describin'  reference 
requests  in  a  medical  library,  classes  ariswers  according  to 
whether  they  are  "direct"  or  "indirect."^  "Direct  ans¬ 
wers"  are  those  in  w..ich  the  librarian  responds,  "It  says 
here.,.";  "indirect  answers"  are  those  lr.  wi.ich  the  re¬ 
sponse  is  "Read  t..is  a..d  find  out."  Because  of  the  fre¬ 
quency  of  biographical  an-  airectory  inquiries  and  requests 
for  verification  of  references,  Kronick  makes  subdivisions 
for  them  in  his  "direct  answer"  category.  With  only  two 
(or  four,  when  "direct  answers"  are  subdivided)  categories, 
arid  these  categories  clearly  defined,  this  is  perhaps  the 
simplest  classification  of  all*  Because  of  the  findings  of 

^David  Kronick,  "Varieties  of  Information  Requests 
in  a  Medical  Library,"  Medical  Library  Assoc iatlon  Bul¬ 
letin.  52  (1964),  pp.  652-669* 
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such  Investigators  as  Hanson?®  and  Herner^  that  pure  sci¬ 
entists  in  particular  prefer  to  do  their  own  searching, 
this  type  of  division  is  valid  in  discussions  of  information- 
seeking  behavior.  The  drawback  is  that  little  is  revealed 
about  the  answer,  other  than  whether  the  librarian  or  the 
questioner  read  the  material  containing  it. 

Kronick's  classification  may  be  expanded,  or  adapted, 
to  one  in  which  the  answer  is  categorized  by  its  type,  or 
format.  Mary  Francillon,  in  an  examination  of  a  year's 
reference  questions  in  a  research  library,  asked  users 
about  the  forms  in  which  they  preferred  their  answers* 

Lists  of  titles  were  favored  over  copies  of  primary  source 
material  by  S0%  of  the  respondents.  There  was  also  a 

llT) 

strong  preference  for  abstracts. 

Probably  most  information-seekers  ac  they  enter  a  li¬ 
brary  have  some  unconscious  expectation  of  the  package  in 
which  the  information  will  be  presented.  They  say  have  in 
mind  a  paragraph  of  descriptive  text  accompanied  by  a  dia¬ 
gram,  an  uttered  word  ( _  is  the  answer),  or  even  "that 

big  red  book  I  used  last  time."  The  format  of  the  response 
to  a  request  will  become  more  important  as  sore  strides  are 

^Hanson,  22.  cit.,  p.  72. 

•^Saul  Herner,  "Information  Gathering  Habits  of  Work¬ 
ers  in  Pure  and  Applied  Science,"  Industrial  and  Engineer¬ 
ing;  Qhemlatrv.  46  (1954),  pp.  228-236. 

An 

Mary  Francillon,  Information  Retrieval:  A  View 
from  the  Reference  Desk,"  Journal  of  Documentation.  15 
(1959),  P.  196. 
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taken  toward  making  man-machine  interaction  a  reality  in 
quest  ion- answering  systems.  J*  C.  R.  I  ‘ckllder,  in  dis¬ 
cussing  precognitive  systems  in  Libraries  of  the  Future , 
writes : 

"we  need  to  substitute  for  the  book  a  device 
that  will  make  it  easy  to  transmit  information 
without  transporting  material,  and  that  will 
not  only  present  information  to  people  but  also 
process  it  for  them,  following  procedures  they 
specify,  apply,  monitor,  and,  if  necessary, 
revise  and  reapply."41 

42 

Ke  mentions,  ae  does  the  description  of  Project  Intrex, 
optical  screens,  cat. ode-ray  tube  displays,  light  pens, 
keyboards  and  hard-copy  displays,  and  telephone  coramunica- 
tion  as  means  by  which  this  may  be  accomplished.  J 

A  knowledge  of  the  most  common  ways  in  which  answers 
are  currently  presented,  and  accepted,  especially  in  sci¬ 
entific  libraries,  will  bo  helpful  in  designing  question- 
answering  systems,  as  well  as  in  analyzing  present 
practices. 

A  possible  classification  of  answers  by  their  formats 
is  clven  in  Part  III. 


C.  R.  Llckliaer,  Libraries  of  the  Future  (Cam¬ 
bridge,  Mass.,  1965) f  p.  6. 

42 

Carl  F.  J.  Overhage  and  R.  Joyce  Harmcn,  Intrex : 
Report  of  a  Planning  Conference  on  Information  Transfer 
Experiments ,  September  2,  1965  (Cambridge,  Mass.,  1965)* 
PP.  33*  47-48. 

^Lickllder,  op.  clt. .  pp.  93-101. 
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PART  III 

A  SUGGESTED  GLASSIFICATION 

The  ciabaiflcation  proposed,  here  includes  five  types: 
exact  reproduction  type,  f il  1-ln-the-blank  type,  descrip¬ 
tive  type,  inf or  nut ion- about  type,  and  Iist~of-references 
type.  (An  outline  of  these  types  and  their  subdivisions, 
with  examples,  follows  an  analysis  of  the  five  categories.) 

The  exact  reproduction  type  includes  both  pictorial 
and  verbal  materials,  which  must  be  seen  by  the  inquirer. 
Pictorial  materials  are  pictures,  maps,  diagrams,  and 
charts.  Verbal  materials  in  this  category  are  copies  of 
historical  documents,  laws,  speeches,  poems,  musical 
scores,  etc.  In  cases  where  this  form  of  answer  i3  pro¬ 
vided,  the  questioner  needs  the  verbatim  text.  Often 
these  materials,  since  they  are  not  listed  as  individual 
documents  in  whatever  passes  for  a  card  catalog,  require 
long  aid  arduous  searches,  using  indexes  and  hunches,  that 
take  them  out  of  the  simple  ,!do  you  have  this  book" 
category. 

The  f ill- l.n- the -blank  type  is  comprised  of  three  cate¬ 
gories:  (1)  short  answers,  in  which  names,  terms,  or 
figures  are  presented  orally  or  in  writing;  (2)  lists  of 
names  or  terms;  and  (3)  tables  of  statistics,  scientific 
numerical  data,  or  other  figures.  This  type  is  character¬ 
ized  by  the  fact  that  there  is  only  one  term,  or  one  set 
of  terms,  which  meets  the  condition  or  conditions  imposed 
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by  the  question.  The  question  has  generally  been  of  Bel- 
nap'a  "which*'  type,  including  "who",  "when",  "where",  and 
sometimes  "what".  Specific  citations  or  verifications  of 
references  are  in  tills  category,  since  in  there  cases  only 
one  answer  is  acceptable.  Where  lists  or  tables  are  given 
as  the  answer,  the  whole  list  may  have  been  needed,  or  only 
one  item  of  data.  (E.>,  the  patron  who  received  a  list  of 
the  Marines  who  were  in  the  picture  of  the  flag-raising  at 
Iwo  J iraa  may  have  wanted  all  of  the  names,  or  he  may  have 
been  Interested  only  i.±  the  name  of  Ira  Hayes.  In  either 
case,  tne  list  was  sufficient  answer.) 

The  descriptive  ty je  is  here  divided  for  convenience 
by  length.  "Short"  answers  contain  a  sentence  to  a  para¬ 
graph;  "long"  ones  run  up  to  a  few  pages.  In  any  event, 
the  material  is  read  by  both  librarian  and  inquirer,  who 
agree  that  It  will  ansvier  the  question.  The  words  of  a 
descriptive  answer  are  only  one  of  many  possible  collec¬ 
tions  of  words  which  comprise  the  ambiguous  alternatives, 
theoretically  infinite  in  number,  presented  by  the  quest¬ 
ion.  A  definition,  for  example,  may  be  worded  in  many  dif¬ 
ferent  ways,  each  of  wnich  is  correct.  The  question  has 
been  of  the  "who"  or  "how"  type,  and  occasionally  "what", 
as  in  "what  is". 

The  inf ormatlon-aoout  type  answers  the  familiar  "in¬ 
formation  on  a  subject"  questions,  or  "subject  requests." 
The  inquirer  is  presented  with  one  or  more  documents  and 
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told  that  here  he  will  find  what  he  wants  to  know  about 
hia  subject* 

The  llst-of-references  type  is  another  form  of  answer 
to  the  same  question,  but  the  seeking  out  of  the  "informa¬ 
tion  about"  is  left  to  the  inquirer. 

It  can.be  seen  that  these  five  types  form  a  continuum 
of  precision.  At  one  end  is  the  "exact  reproduction"  type, 
where  the  librarian  knows  that  what  is  presented  is  Just 
what  the  inquirer  asked  for,  and  this  is  verified  by  the  in¬ 
quirer.  At  the  other  end  is  the  " list-of-references  type", 
where  the  questioner  leaves  with  a  bibliography  or  a  scrib¬ 
bled  set  of  call  numbers  in  his  hand,  and  the  librarian  is 
not  at  all  sure  that  the  information  provided  will  in  fact 
lead  the  inquirer  to  what  he  seeks. 

The  first  two  types  ("exact  reproduction"  and  "flll-ln- 
the  blank")  are  likely  to  correspond  most  closely  to  what¬ 
ever  package  the  inquirer  had  In  mind  before  beginning  his 
search.  They  also  have  smaller  log on- contents,  for  there 
are  only  a  given  number  of  pictures  of  the  Trojan  horse, 
only  one  Gettysburg  Address,  and  only  a  few  terms  or  sets 
of  terms  which  will  fill  a  given  blank*  The  other  three 
types;  being  less  specific,  have  high  logon-contents,  and 
may  not  be  at  all  the  type  of  package  the  questioner  was 
expecting* 
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An  outline  of  the  classification  scheme  is  given 
below,  with  examples  from  the  Lehigh  collection  of  quest¬ 
ions  and  answers. 

A.  Exact  reproduction  type 
1*  Pictorial 

a.  rictures 

Example:  A  picture  of  the  Phi  Beta  Kappa 
key. 

b.  Maps 

Example:  A  map  of  Allentown,  Pa.  (Quest¬ 
ion:  location  of  a  specific  street). 

c.  Diagrams 

Example:  A  flow  chart.  (Question:  I 
need  to  draw  a  flow  chart  and  don't  know 
what  they  look  like.)  It  is  true  that 
an  article  on  flow  charting  might  also 
havt;  been  useful,  but  in  this  case  the 
diagram  was  sufficient. 

2 .  V  erba 1 

Example:  A  copy  of  the  Congressional  resolu¬ 
tion  making  Winston  Churchill  an  honorary 
citizen  of  the  U.S. 

Example;  A  copy  of  "Paul  Revere' s  Ride." 

B.  Fill- in- the- blank  type 
1.  Short  answer 

Example:  Francis  Thompson  (Question:  Who 
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wrote  "The  Hound  of  Heaven?”) 

Example:  34  Beacon  Street,  Boston  6 
(Question:  What  is  the  address  of  Little, 
Brown  &  Co?) 

2.  List 

.  Example:  A  list  of  the  members  of  the  United 
States  Congress  from  Pennsylvania  in  1811-12. 
3*  Tabulations 

Example:  Periodic  table  (Question:  What  is 
the  atomic  weight  of  mercury?) 

C.  Descriptive  type 
1*  Short 

Example:  Paragraph  about  Rachel  Carson  in 
Who' a  Who  In  America. 

Example:  "A  monopsonist  is  one  who  is  a 
single  buyer  for  a  product  or  service  of  mai^r 
sellers.” 

2.  Long 

Example:  Two  and  a  half  pages  about  George 
Bernard  Shaw  in  Twentieth  Century  Authors. 
Example:  A  page  in  The  Chemical  Engineer*  s 
Handbook  (Question:  How  does  a  pitot  tube 
work?) 

D.  Informat lon-about  type 

Exanjple:  Several  books  and  a  lengthy  article  in 
the  Catholic  Encyclopedia  on  the  Roman  Catholic 


mass 
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E.  Llst-of-references  type 

Example:  Pages  in  several  issues  of  the  Reader1 a 

Guide  listing  articles  on  Afghanistan. 

Hanson’s  remarks  about  informat ion- seeking  behavior 

have  some  relevance  to  this  outline.  In  discussing  all 

"acts  of  library  use,"  he  asserts  that: 

"Something  approaching  one  fifth  of  the  demand 
is  for  a  figure,  or  a  single,  simple  fact.... 
between  a  quarter  and  a  tnird  of  the  total  demand 
is  for  a  description  of  an  ooject,  a  process,  a 
method  or  procedure. "44 

The  "f ill- in-the -blank  type"  answer  is  analogous  to  Hanson’s 
"demand  for  a  figure  or  single  simple  fact;"  the  "descrip¬ 
tive"  and  "inf ormation-about"  typeB  together  to  his  "demand 
for  a  description  of  an  object,  a  process,  a  method  or 
procedure." 

A  tabulation  of  the  five  types  of  answers  as  they  were 
presented  at  Lehigh  is  shown  in  Figure  1. 

The  figures  in  the  table  are  presented  to  show  that 
each  category  contains  enough  items  to  give  it  some  validity, 
although  the  percentages  may  not  present  an  accurate  pic¬ 
ture.  As  was  stated,  272  inquiries  are  a  fraction  of  the 
total  received.  While  it  was  felt  that  all  types  of  quest¬ 
ions  and  answers  were  included  in  the  collection,  it  is 
likely  that  the  proportion  of  each  type  to  the  total  of  the 

44 

Hanson,  op.  clt. .  p.  66. 
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Type  of  Answer 

Number 

Per  Cent 

Exact  reproduction 

Pictorial 

Pictures 

8 

2.9 

Maps 

7 

2.8 

Diagrams 

2 

sit 

Total 

17 

Verbal 

16 

^2 

Total 

33 

12.1 

Fill-in-the-blank 

Short  answer 

101 

37.9 

List 

25 

9.2 

Tabulation 

4 

47.8 

Total 

130 

Descriptive 

Short 

25 

9.2 

Long 

28 

10^ 

Total 

53 

19.5 

Information  about 

42 

15.5 

Li s t- of -re  f ere  nc  e  s 

14 

— 5.a 

Total 

272 

100.0 

Figure  1 


collection  is  not  the  same  proportion  of  that  type  to  the 
total  number  of  questions  asked. 

The  large  number  of  short,  specific  answers  is 
probably  a  reflection  of  the  nature  of  the  collection. 
UserB  of  an  academic  library,  because  they  are  accustomed 
to  performing  their  own  searches  for  general  information 
about  a  subject,  are  inclined  to  approach  librarians  only 
for  specific  data.  Also,  librarians  are  more  likely  to 
record  a  specific  fact  that  was  difficult  to  find  than  an 
unusual  subject  request.  Probably  the  proportion  of 


"informat ion- about"  and  " list-of-references"  answers  was 
much  higher  than  is  shown  here.  In  light  of  Francillon' a 
findings  about  the  number  of  users  who  needed  primary  source 
material, ^  the  figures  for  "exact  reproduction  type"  are 
probably  fairly  realistic.  Some  specialized  libraries  may 
have  more  requests,  and  answers,  involving  pictorial  ma¬ 
terial.  An  art  library  is  an  obvious  example,  or  a  library 
serving  chemists  who  need  to  see  models  of  molecular 
structures. 


45 


Frame! lion. 


loc.  clt. 
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PART  IV 

REC OMMENDAT 10 1C  AM)  IMPLICATIONS 

No  claim  can  be  made  that  the  analysis  of  the  question- 
answer  process  just  described  is  better  than  other  methods, 
without  further  testing  of  it*  The  collection  of  questions 
and  answers  examined  was  a  small  one,  and  much  of  the  data 
were  recorded  before  the  classification  system  was  devel¬ 
oped,  Because  the  boundaries  of  each  class  are  sufficient¬ 
ly  clear  to  require  a  minimum  of  difficult  decision-making, 
testing  should  be  relatively  easy,  A  form  Buch  as  the  one 
shown  in  Figure  2  is  all  that  would  be  required. 


Check  form  of  answer  supplied  Date 


Pictorial 

_  Short  description 

Map 

_  Long  description 

Diagram 

Information  about 

Fact 

_  List  of  references 

List 

Table 

Was  the  inquirer  satisfied? 

_  Yes  _  Partially  _  No  _  Unknown 

Figure  2 

As  can  be  seen  from  this  suggested  form,  information 
about  the  answer  could  be  combined  with  other  data,  such 
as  user  satisfaction.  If  desired,  space  could  be  provided 
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for  a  statement  of  the  question  itself,  type  of  user,  the 
name  of  the  source  used,  reasons  for  user  dissatisfaction, 
etc. 

There  is  some  justification  for  carrying  out  such  a 
test.  As  well  as  being  simply  performed,  its  results  are 
reasonably  plain  and  easily  quantified,  and  can  be  cross- 
tabulated  with  other  variables. 

If  Voigt* s  assertion  that  the  user’s  approach  is  re¬ 
flected  in  the  materials  that  answer  his  question  is  ac¬ 
cepted,  an  analysis  of  these  materials,  combined  ,'ith  data 
about  the  user,  may  be  of  assistance  to  those  who  wish  to 
study  inf or mat ion- seeking  behavior.  Investigating  refer¬ 
ence  service  in  this  manner  is  more  objective  than  ad¬ 
ministering  questionnaires  to  ascertain  how  mapy  Journals 
a  person  reads  or  which  colleagues  he  asks  for  help. 

Knowledge  of  format  preferences  should  be  of  parti¬ 
cular  interest  in  the  design  of  and  experimentation  with 
que st ion- answer ing  systems  Involving  man-machine  inter¬ 
action.  Lists  of  references  and  exact  reproduct ion- type 
material,  if  predictable,  such  as  molecular  structures  or 
maps,  are  formats  which  can  be  stored  in  memory  and  dis¬ 
played  on  optical  screens  or  cathode-ray  tube  devices,  as 
described  in  Libraries  of  the  Future  and  the  Project  Intrex 
report*  Interaction  via  alphanumeric  keyboards  in  conjunc¬ 
tion  with  hard-copy  devices  can  produce  from  storage  in¬ 
formation  in  the  form  of  lists  of  references,  predictable 
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short  answers,  and  lists.  Telephone  connections  between 
user  and  machine  may  ultimately  make  feasible  the  communi¬ 
cation  of  short  f 111-ln-the-blank  type  or  descriptive  type 
Information  that  is  at  present  often  transmitted  by  voice. 
An  analysis  of  desired  configurations  of  answers  combined 
with  a  study,  of  system  capabilities  Bhould  aid  In  designing 
the  best  possible  system  for  a  given  situation. 

If  a  library  still  insists  on  classifying  questions  by 
type  or  subject,  such  a  classification  can  be  related  to  a 
classification  of  answer  formats.  There  could  be  some  in¬ 
teresting  implications,  for  example,  in  a  finding  that  peo¬ 
ple  wno  ask  questions  about  coal  mining  usually  want  dia¬ 
grams,  or  that  astrophysicists  prefer  short,  specific 
answers.  Results  could  lead  to  new  arrangements  of  refer¬ 
ence  collections,  or  the  development  of  different  search 
strategies  for  different  clienteles  or  questions. 

The  happiest  arrangement,  of  course,  would  be  for  the 
librarian  to  learn  at  the  outset  of  a  search  how  the  in¬ 
quirer  wants  his  answer  delivered.  Having,  for  instance, 
the  hypothetical  knowledge  that  people  interested  in  coal 
mining  usually  want  diagrams,  the  librarian  •'.ould  ask,  "Do 
you  want  this  in  diagrammatic  or  in  some  other  form?"  Or, 
after  a  librarian  has  established  what  the  question  is  and 
has  learned  something,  either  by  observation  or  by  asking, 
about  the  inquirer,  knowing  that  the  answer  is  likely  to 
be  beat  presented  and  best  received  as  (in  the  hypothetical 
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case)  a  diagram  will  induce  the  librarian  to  look  first  in 
sources  that  provide  diagrams. 

Search  strategies  approached  from  this  point  of  view 
lend  themselves  to  programmed  instruction.  To  the  knowledge 
of  tnis  writer,  only  one  programmed  text  has  been  developed 
for  library  use,  an  instruction  in  use  of  the  card  catalog 

j.  r- 

at  West  Virginia  University.  °  A  programmed  lesson  about 
search  strategies  and  desired  answers  might  look  somewhat 
as  shown  in  Figures  3-5. 


Page  2 

Choose  one  of  the  following  subjects  you 
would  like  to  know  more  about  and  turn  to 
the  page  indicated* 

The  year  aitler  became  Chancellor 
of  Germany.  Turn  to  page  4. 

Atomic  weights  of  some  of  the 
elements.  Turn  to  page  97* 

7/hat  the  moon  looks  like.  Turn 
to  page  32. 

The  riames  of  George  Bernard  Shaw's 
plays.  Turn  to  page  45. 

How  a  pitot  tube  works.  Turn  to 
page  81. 


Figure  3 


The  student  decides  he  wants  to  know  how  a  pitot  tube 
works  and  turns  to  page  81. 


^ John  W.  Howard,  U s inp  the  Health  Sciences  Library. 
I.  The  Card  Catalor.  (Morgantown,  We st  Virginia,  1964) . 
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Page  81 

In  what  form  do  you  prefer  the  answer? 

List  of  references.  Turn  to  page  43. 

All  the  information  about.  Turn  to 
page  101. 

Diagram.  Turn  to  page  J6. 

Picture.  Turn  to  page  68. 

Short  definition.  Turn  to  page  52. 

One- or- two- page  description.  Turn  to 
page  60 • 

Figure  4 


The  student  selects  a  one-or- two-page  description  and 
turns  to  page  60. 


Page  60 

The  sort  of  information  you  are  looking  for 
may  be  most  conveniently  found  in  a  handbook 
or  technical  encyclopedia.  For  a  list  of 
chemical  handbooks  in  the  library,  search  the 
card  catalog  under  the  heading: 

” Chemistry  -  Tables,  etc.’* 

Some  suggested  handbooks  in  the  reference 
collection  are  the  following: 

Lange.  Handbook  of  Chemistry. 

Perry.  Chemical  Engineer's-  Handbook. 

Chemical  Rubber  Company.  Handbook  of 
Chemistry  and  Physics. 


Figure  5 


If  the  student  had  desired  Information  about  other 
subjects,  or  in  other  formats,  he  would  have  found  similar 
discussions  and  suggested  reference  books  on  the  other  pages. 

A  programmed  textbook  of  tnis  type  could  be  used,  as 
is  the  West  Virginia  manual,  in  assisting  college  and  uni¬ 
versity  students  in  learning  about  the  library.  It  might 
also  have  some  value  in  training  reference  personnel  in 
small  libraries  whose  employees  have  not  had  formal 
education  in  library  science. 

The  classification  of  answers  described  in  this  thesis 
is  but  one  small  step  toward  the  development  of  new  tech¬ 
niques  f«r  analyzing  and  evaluating  reference  services  in 
libraries.  Other  methods,  and  refinements  and  emendations 
of  thlB  one,  are  doubtless  needed.  The  system  proposed 
here  is  put  forward  because  of  its  simplicity  and  relative 
straightforwardness,  the  ease  with  which  it  may  be  used  in 
combination  with  other  data,  and  Its  applicability  in 
"libraries  of  the  future"  as  well  as  libraries  of  the 
present. 
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